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When designing the observing modes for HIFI, the het- power or spectroscopic fluctuations, thus neglecting a large 
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velop a reliable Allan variance computation method for charac- 2000), considers all variations across the spectrometer, but it ig- 
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ABSTRACT 

Context. The Allan variance is a standard technique to characterise the stability of spectroscopic instruments used in astronomical 
observations. The period for switching between source and reference measurement is often derived from the Allan minimum time. 
However, various methods are applied to compute the Allan variance spectrum and to use its characteristics in the setup of astronomical 
observations. 

Aims. We propose a new approach for the computation of the Allan variance of spectrometer data combining the advantages of 
the two existing methods into a unified scheme. Using the Allan variance spectrum we derive the optimum strategy for symmetric 
observing schemes minimising the total uncertainty of the data resulting from radiometric and drift noise. 

Methods. The unified Allan variance computation scheme is designed to trace total-power and spectroscopic fluctuations within the 
same framework. The method includes an explicit error estimate both for the individual Allan variance spectra and for the derived 
stability time. A new definition of the instrument stability time allows to characterise the instrument even in the case of a fluctuation 
spectrum shallower than 1//, as measured for the total power fluctuations in high-electron-mobility transistors. 
Results. A first analysis of test measurements for the HIFI instrument shows that gain fluctuations represent the main cause of 
instrumental instabilities leading to large differences between the stability times relevant for measurements aiming at an accurate 
determination of the continuum level and for purely spectroscopic measurements. Fast switching loops are needed for a reliable 
determination of the continuum level, while most spectroscopic measurements can be set up in such a way that baseline residuals 
due to spectroscopic drifts are at a lower level than the radiometric noise. We find a non-linear impact of the binning of spectrometer 
channels on the resulting noise and the Allan time deviating from the description in existing theoretical treatments. 

Key words. Methods: data analysis - Methods: statistical - Instrumentation: spectrographs 

1. Introduction terising the instrument stability so that the precious observing 

time is efficiently used in astronomical observations. The tech- 
All radio-astronomical measurements are affected by instabili- n ique developed here can be applied in the same way to any 
ties of the gain, the transmission function, and the internal sys- ground-based telescope when the instability of the atmosphere 
tem noise changing the absolute scale of the measured signal. To i s included in the measurement by looking at blank sky through 
compensate for these drifts, one switches between the astronom- the atmosphere. 
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nores total-power drifts and allows no identification of problem- 
atic channel ranges within the spectrum. 

Here, we propose a new scheme which unifies the different 
approaches into a single mathematical description and largely 
fulfils the four requirements. The request for a complete charac- 
terisation of the spectral behaviour of the possible instabilities 
will be translated into the need for a computation of the Allan 
variance independently for each backend channel, so that chan- 
nel by channel variations can be detected, the influence of stand- 
ing wave instabilities becomes visible, and regions of instabili- 
ties across the IF band can be identified. 

The requirement for an efficient data use is fulfilled by ac- 
tually using the data from all spectrometer channels and by tak- 
ing into account all possible statistically independent samplings 
of the temporal behaviour in the analysis. This efficient use of 
data helps to shorten the actual time needed to acquire the data. 
Although a complete characterisation of the instrumental stabil- 
ity requires very long time series of measurements, the deriva- 
tion of the Allan variance minimum and the drift index of fluc- 
tuations at time scales in the order of the Allan minimum time 
can be obtained from a measurement that lasts only about three 
Allan minimum times. Focusing on these two quantities being 
the actually limiting factors for the planning and the calibration 
of astronomical observations allows to draw significant conclu- 
sions also from reasonably short time series, thus saving observ- 
ing time. 

Even if the time series of measurements is too short to guar- 
antee a complete statistical invariance of the data, we can derive 
an explicit error estimate for the Allan variance from the count- 
ing statistics of the data taking. With the new definition of the 
Allan time proposed here this also provides a direct measure for 
the error of the Allan stability time. The request for a fast imple- 
mentation is fulfilled by the proposed convolution schemes for 
the measured data, either in the time domain or in the Fourier 
domain. 

In Sect. 2 we discuss the influence of different data normali- 
sation schemes. Sect. 3 summarises our algorithm for the actual 
Allan variance computation including the error estimate. Sect. 
4 discusses the best definition of a stability time and the effect 
of the binning of spectrometer data and Sect. 5 uses the results 
to derive the optimum observing strategy for all symmetric as- 
tronomical observing schemes. The implications for asymmetric 
schemes like on-the-fly mappings will be discussed in a separate 
paper. Sect. 6 summarises our results. 



2. Data handling 

2.1. Normalisation across spectrometers 

To perform an instrumental stability analysis a time series of 
spectral dumps has to be taken consisting of spectrometer count 
rates c,(f^.), where the index i denotes the channel number across 
the backend and tk gives the time for the spectral dump with 
index k. The existing Allan variance analysis tools always as- 
sume that the readout dead time for an individual data dump is 
negligible relative to the integration time between two dumps. 
Depending on the instrumental operation, this assumption may 
be violated in some cases and we will discuss the effect of dead 
times below. We have to assume, however, that every measure- 
ment Ci(tk) covers the same integration time. 

The spectrum of counts per channel c, on any source is al- 
ways dominated by the system bandpass of the instrument which 
is rarely flat and may be strongly varying across the covered fre- 
quency range. Astronomical data are thus calibrated with respect 



to this bandpass using two reference measurements, obtained 
from the blank sky and one or two thermal calibration sources 
dKutner & Ulichl Il98lh . to deduce the actual input signal. To 
make the stability analysis directly applicable to astronomical 
measurements, the same normalisation should be used instead 
of working with raw backend count rates. However, a full astro- 
nomical calibration is neither practical nor necessary. The band- 
pass can be approximated by the average signal level obtained in 
the measurement corrected by the zero level of the instrument. 
A useful normalisation of the spectra is thus provided by 



Si(t k ) 



Cjjtk) ~ Zj 



(1) 



where z, is the zero level of channel i and the temporal aver- 
age of each channel is used to normalise the signal level of that 
channel. This norma lisation is also u sed in the baseline Allan 
variance analysis by ISiebertzl (Il998l) . It results in an approxi- 
mate equivalence of all backend channels so that differences in 
their mutual behaviour appear on the same scale. All variations 
are seen relative to the signal level so that they can be compared 
directly to calibration errors and the radiometric noise level. 

2.2. Spectroscopic versus total power normalisation 

Most fluctuations in the amplifiers or other components of the 
signal path lead to variations which are constant across the whole 
bandpass. Observations which do not switch between source and 
reference on a time scale short compared to the corresponding 
fluctuations will exhibit baseline offsets in the calibrated data. 
However, most astronomical heterodyne observations are not in- 
tended to obtain an accurate continuum level but for the mea- 
surement of lines on top of a constant baseline which is typically 
taken to be zero. In this case, only fluctuations which do not af- 
fect all channels in the same way result in a degradation of the 
calibrated astronomical data. Spectroscopic fluctuations change 
the mutual response between different channels, often seen as 
ripples or steps in the baseline. 

Astronomical observations thus call for two different kinds 
of instrument stabilities, a total power stability and a spectro- 
scopic stability. Two different types of Allan variance analyses 
are required. The total power Allan variance has to trace all 
instrumental variations. It is computed directly from the nor- 
malised spectra as given in Eq. ([T). The spectroscopic Allan 
variance measures only instabilities deviating from a common 
gain variation across the whole ban d. In the origina l defini tion of 
the spectroscopic Allan variance by Schied er"et alj d 19851) this is 
accomplished by considering the difference signal between two 
channels i and j. This approach, however, suffers from the arbi- 
trariness of the selection of these channels and the impossibility 
to distinguish the contributions from either of the channels. To 
avoid these problems, we propose to use the average over the 
whole backend to subtract the continuum level fluctuations. We 
extend Eq. ([]]) by this difference for the spectroscopic Allan vari- 
ance computation: 



Ci(t k ) ■ 



Cj(t k ) - Zj 
(ci(tk) - zi)k \ (ci(tk) - zi)k 



(2) 



This spectroscopic normalisation corresponds to the subtraction 
of a zero-order bas eline in the Allan variance method proposed 
by ISieberta (119981) . For long time series, the resulting spectro- 
scopic Allan variance spectra are also equivalent to the average 
of two-channel Allan variance spectra taken over all reference 
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Fig. 1. Time series of spectrometer data where either the total- 
power normalisation (Eq. [1] upper plot) or the spectroscopic 
normalisation (Eq. [2] lower plot) is applied. The data were 
taken in stability measurements of the HIFI band 6 IF chain 
in V-polarisat i on us ing the wide band spectrometer (WBS, 
ISchieder et all 120001) in June 2007. The three WBS subbands 
covering the available IF bandwidth are plotted sequentially, ap- 
pearing as a single spectrometer with 4556 channels. 



channels j, except for the small contribution from the consid- 
ered channel i itself to the average which is not used in the two- 
channel spectroscopic Allan variance. 

Fig- E illustrates the two normalisations by plotting a time 
series of spectrometer data both for the total power and 
the spectroscopic approach. Most variations are seen to occur 
equally in all channels so that they are mainly visible in the total 
power data. However, we also see some differential variations in 
terms of gain changes across the full band and variable standing 
wave features showing up as weak structures in the spectroscop- 
ically normalised plot. 

HIFI and a number of other receivers cover a large band- 
width by combining several sub-spectrometers with a smaller 
bandwidth into one large array. In these array spectrometers, 
the different subbands will see partially different signal chains 
so that they may show different stability behaviours. Each sub- 
band has to be characterised individually. Thus all averages over 
the channels i were computed only within the spectrometer sub- 
bands. In this way, we provide the stability numbers relevant for 
individual narrow lines, but we disregard the spectral purity of 



the full baseline. The latter may show steps between the differ- 
ent subbands due to dynamic platforming, i.e. a mutual drift of 
the gain between the subbands. To include these effects a second 
spectroscopic normalisation needs to be used where the average 
over all channels i in Eq. (f2]l is computed for the full spectrom- 
eter. Examples are given in Sect. 4. In case of sufficient overlap 
between the subbands, dynamic platforming can be corrected in 
the data reduction process so that we can restrict ourselves to the 
stability analysis for the individual subbands. 

Altogether, each stability measurement characterises two 
kinds of instabilities. When performing the analysis at the nor- 
malised data given by Eq. (Q} we measure the total power stabil- 
ity. This result has to be used when setting up observations which 
aim for a determination of the continuum level, as is the case 
for measurements of absorption lines. With the spectroscopically 
normalised data from Eq. © we measure the spectroscopic sta- 
bility, that can be used for observations which do not aim for an 
accurate determination of the continuum level, e.g. observations 
of molecular emission lines. The spectroscopic stability always 
exceeds the total power stability leading to more efficient ob- 
serving schemes, so that one has to find a compromise between 
the need for an accurate continuum level determination and the 
request for a high observing efficiency. 

3. Computation of the Allan variance 

3. 1 . Convolution schemes 

The computation of the Allan variance consists of a convolution 
of the signal data from Eqs. ([1) or (f2]i by a Haar wavelet of 
size L 



l/L for - L < t < 
-l/L for0<f<L 
everywhere else 



(3) 



and the computation of the variance of the convolved signaQ Q: 



' A, A 



,.(L) = l( Si (t k ) * r L L - ( Si (t k ) * V),/ 



(4) 



Plotting the Allan variance cr^(L) as a function of the filter size 
L shows the variation of the signal on the scale of the tempo- 
ral lag L. Computing the Allan variance by actually convolving 
the time series by the '"[j -filter function for each time step can 
be considered a waste of computing time, because neighbouring 
values in the convolved time series are no longer statistically in- 
dependent. Independent convolution results are only obtained for 



1 Note that the original definition of the Allan variance is smaller by 
a factor 1/2. We omit this factor to allow a direct comparison to the drift 
error in observations. 

2 The variance definition used here is 



a- 2 = (U> - (xk)k) 2 ) k = jj ^j( x k ~ (xk) k ) 2 



This deviates from the ordinary variance definition 



N - 



7 X/** ~ ^ x *^) 2 



for small numbers N. It has, however, the advantage that it is indepen- 
dent of the exact way of sampling a given continuous distribution, mea- 
suring only the internal properties of the distribution, as long as the 
sampling is dense enough. 
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points separated by a lag larger than the filter size L. A more effi- 
cient method is thus to compute the convolu tion integral only fo r 
filter settings separated by the filter size dSchieder et all U985I) . 
When we chose filter length L to be an integer multiple of the 
step size Af = tk+i - h, i.e. L — I x At, we can use the average 
over a reduced number of points to compute the Allan variance 

ai/L) = ((Si(K) - St(K + 1) - (Si(K) - S,(K + l)) K f) K (5) 
with 



(K+\)l+ki-\ 



k=Kl+k, 



(6) 



Compared to the full convolution (Eq. |4]i this corresponds to 
counting only points separated by L in the convolved function 
Si(tk) * Tjz. wnen computing the variance. Each data point of the 
signal contributes twice - once in the positive and once in the 
negative term for the binned signal. 



10" 6 F 
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Fig. 2. Spectroscopic Allan variance spectrum computed by dis- 
crete sampling of the time series in steps of the lag L for all pos- 
sible starting points l\ in the time series (upper plot) compared 
to the spectrum computed by full convolution of the time series 
with the r ]j-wavelet (lower plot). The crosses in the lower plot 
represent the result from the L-sampled computation for k\ — 1 . 
The error bars shown for the results from the full convolution 
integral are determined by the statistical uncertainty due to the 
finite number of data points (see Sect. 13 2\ . 



One disadvantage of this method is the loss of information 
from points at the beginning or the end of the time series which 
are not covered by full intervals of size 2L. The discrete sam- 
pling approach necessarily ignores an arbitrary fraction of the 
data at the beginning or end of the time series when the time se- 
ries does do not match integer multiples of the filter size. This 
is obviously a small effect for small filters, but leads to a notice- 
able effect for large filters. Moreover, the selection of the start 
frame k\ for the convolution is arbitrary. By shifting this through 
one filter length, different results are obtained for the Allan vari- 
ance in case of a finite statistics in the time series of data. This is 
demonstrated in Fig.|2^. For each filter lag L we have computed 
the result of Eq. Q when shifting the start frame k\ through the 
full filter length 2L. We find a large scatter in particular for large 
lags, i.e. a noticeable uncertainty of the result which depends on 
the arbitrary selection of this start frame. We can compare this 
with the result from the full convolution of the time series in 
Fig.|2j). The Allan variance from the full convolution provides a 
very smooth curve while the data from any particular L sampling 
(shown in Fig.[2j3 for k\ — 1) show a considerable scatter around 
this curve. Nevertheless, almost all values fall within the statis- 
tical error bars computed from the finite size of the data series 
below. 

We can conclude that the brute-force approach of the full 
convolution of the time series with the filter function provides 
the best results by not neglecting any data and by guarantee- 
ing that every feature in the spectrum is covered by an appro- 
priate filter setting. This results in smooth curves of the Allan 
variance spectra facilitating fitting and interpreting by the naked 
eye. Using today's computer technology, the convolution is prac- 
tically possible by means of a Fast-Fourier transform for spec- 
trometer time series of up to a few thousand steps. For longer 
time series, the numerically simpler approach of the discrete 
sampling can be used. The sampling in steps of L still pro- 
vides reliable data within the statistical uncertainty inherent to 
the Allan variance analysis. However, the noticeable error bars 
for large lags always have to be taken into account. 

3.2. Error estimate 

To compute the statistical uncertainty of the Allan variance we 
concentrate on this intrinsic uncertainty of the method neglecting 
the error propagation of possible uncertainties of the measured 
data into the Allan variance values. 

The statistical error results from the sampling error when 
scanning a continuous distribution f(t) by taking data values 
at discrete randomly selected points K. It is well known that the 
uncertainty in the determination of the average value of the sam- 
pled distribution is given by a Poisson counting error and the 
variance of the distribution 



S(f)K 



(if-(f)tf)l 



N 



(7) 



Equivalently, one can derive the uncertainty of the measured 
variance of the distribution caused by the discrete sampling as 



m-(f) K f)K = 



({f-(f)tY) t -{(f-(f)t?) 2 t 



N 



= {{f-{f),f), 



Kur- 1 



N 



(8) 



where Kur denotes the kurtosis of the distribution, characteris- 
ing its fourth moment. Gaussian distributions exhibit a kurtosis 
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value of 3. Exponential distributions show Kur - 6. Thus the 
relative accuracy of the measured variance of a distribution de- 
pends mainly on the number of points used to sample the distri- 
bution. The kurtosis measuring the relative strength of the wings 
of the distribution weighs this counting error by a factor of a few. 

It is obvious that these principles apply as well to the deter- 
mination of the Allan variance. As discussed above, each dis- 
tribution of filter-convolved data values can only be sampled in 
steps of L to obtain statistically independent values. If the data 
represent a random series, sampling in uniform time steps cor- 
responds to a random sampling of the distribution of data values 
so that the equation above can be applied. This assumption is not 
always fulfilled in the measurement of drift processes but it is in 
general justified when sufficiently long time series are measured. 
Thus we can estimate the statistical error of the Allan variance 
for a time series with the length N x Lby 

l(Zf k (L)} k -(Zf k (L)} 2 k 
5 <W = A/ — N (9) 

with 

Z a (L) = Si (t k ) * 1j L - ( Si (t k ) * 1,^ . (10) 

These error bars are plotted in Fig. [2] When comparing the plots 
in Fig. |2j it is remarkable that the scatter obtained while varying 
k\ gives a very good match to the statistical uncertainty shown 
as error bars of the convolved data. 

3.3. How to characterise a full spectrometer? 

All computations so far were restricted to a time series of ar- 
bitrary data, i.e. an individual spectrometer channel i, but they 
ignored that a full instrument consists of thousands of spectrom- 
eter channels which are partially, but not completely indepen- 
dent. 

The first approach to characterise the full spectrometer is the 
computation of the Allan variance channel by channel and the vi- 
sualisation of the result in a three-dimensional plot. The result of 
such a channel-by channel analysis is demonstrated in the upper 
part of Fig. [3] showing the total-power Allan variance in loga- 
rithmic units for the HIFI test measurement from Fig. Q] Three 
subbands of the wide band spectrometer cover the full spectrum; 
their boundaries are visible at channels 860 and 2708. We clearly 
see that the instability of the system is dominated by a kind 
of standing-wave pattern superimposed on a large-scale trend 
of higher stabilities at lower frequencies (smaller channel num- 
bers). We find a pattern of alternating regions of more and less 
stable channels. This can be interpreted in terms of the baseline 
of example spectra. The lower plot in Fig.Q]shows the difference 
of two spectra obtained by averaging over two adjacent 500 s in- 
tervals. We recognise a kind of standing-wave baseline distortion 
with a period matching the features visible in the Allan variance 
spectra. The amplitude of this baseline distortion grows towards 
higher channel numbers where we find larger values of the Allan 
variance at the upper boundary of the three-dimensional plot cor- 
responding to L « 500 s. 

From this plot it is obvious that variations of the instrumen- 
tal behaviour across the spectrometer have to be considered. This 
provides the full information, but has the practical disadvantage 
that a surface plot is more difficult to interpret by eye than a 
two-dimensional plot, that it is not possible to include informa- 
tion about the error bars in the plot, and that for the optimisation 
of the observing strategy we have to reduce the result to a few 
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Fig. 3. Channel-by channel total-power Allan variance spectra 
for the test measurement described in Fig. Q] (upper plot). The 
colour coding shows the logarithm of the Allan variance. The 
lower plot shows the difference of two spectra obtained by aver- 
aging over two consecutive 500s intervals. 



numbers. To get a rough feeling for the spectral behaviour one 
can also look at the difference baseline plot, however, the corre- 
sponding interval has to be selected arbitrarily, missing most of 
the statistics of the measurement, so that a single baseline can 
never provide all the information contained in the channel-by- 
channel Allan variance plot. 

For the derivation of constraints for the observing strategy 
it seems plausible to characterise the whole instrument by the 
properties of the worst, i.e. most unstable channel. This is the 
most reliable approach also applicable to observations where the 
measurement in all channels is equally important, e.g. in fre- 
quency surveys of rich emission spectra with hundreds of lines 
per spectrum. However, it does not take into account that in most 
observations the observed lines cover only a very small fraction 
of the whole spectrometer output whereas bad channels are typ- 
ically concentrated towards the edges of the IF band. Then, an 
average Allan variance spectrum is more appropriate. 

One can consider three different ways of averaging. When 
starting from the channel-by-channel Allan variance analysis an 
average Allan variance spectrum is given by 

oi(L) = ^( Si (t k ) * 1, L - ( Si (t k ) * 1, L ) J 2 ) J . (11) 
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Fig. 4. Comparison of the four possible ways to characterise 
a full spectrometer band by a single Allan variance spectrum. 
Spectroscopically normalised data from the central subband 
shown in Fig.Q~|have been used. The results when averaging the 
baseline Allan variance plots and when determining the variance 
relative to the grand average including simultaneously the chan- 
nel scale and the time scale are so close that the curves are hardly 
distinguishable by eye. 

This approach corresponds to averaging the Allan variance spec- 
trum obtained from two channels following the method by 
ISchiederetafl(fl98l over all pairs of channels. 

A second possib le approach is u sed by the baseline Allan 
variance method by Siebertzj (Il998l) . The variance within the 
convolved spectrum for each time step is considered and in a 
second step the average over all time steps is performed. We can 
write this as 

ai(L) = ^(jife) * 1j L - ( Si (t k ) * r hi)f)) k ■ d2) 

This kind of averaging is not able to monitor total-power vari- 
ations because they enter the data * r |j L in the same way 
as (stfe) * l ~lj L y so that they are subtracted and removed from 
the Allan variance spectrum. Therefore, the variance can only 
measure the spectroscopic Allan variance of an instrument. 

The third option is to determine the variance relative to the 
grand average of the normalised and convolved spectra from the 
whole data field 

ai(L) = |(j»«k) * ^ - (siih) * Iil)*,,) 2 ^ ■ (13) 

The result for the spectroscopically normalised time series of 
the HIFI test measurement shown in Fig. Q] are demonstrated in 
Fig-E] At all time lags below 100 s the different averages show 
identical Allan variance spectra with a slope of - 1 characteristic 
for white radiometric noise. In contrast, the selection of the worst 
channel shows that this experiences some additional fluctuations 
even at the scale of 1 s and a drift noise growing to the amplitude 
of the radiometric noise already after 20 s. Consequently, the 
relevant stability times are very short if one has to guarantee that 
the drift contribution remains small for each individual channel. 
The vast majority of all spectrometer channels behaves in a much 
more stable manner. 

Comparing the average of the baseline Allan variance with 
the Allan variance using the grand average in the difference 
shows very similar spectra which are hardly to distinguish by 



eye, i.e. the variation of the convolved data relative to the average 
over the spectrum at a given time step is almost identical to the 
variation relative to the global average. In contrast, the average 
of the channel Allan variance spectra is always smaller at large 
lags, i.e. the variation of the convolved data relative to the aver- 
age in the corresponding channel is always smaller than the vari- 
ation relative to the global average. This can be understood from 
the the bandpass normalisation and the spectroscopic normali- 
sation of the signal Si(tk) discussed in Sect. 12.11 The bandpass 
normalisation guarantees that the average (s^tk))^ of any chan- 
nel i is identical to the global average (Sife))*; whereas the spec- 
troscopic normalisation leads guarantees the identity = 
(si(tk))kj f° r eacn ti me step. For spectroscopically normalised 
data, the convolution with the Allan filter hardly changes the av- 
erage of the individual spectra, (ij(^it) * Tjl); ~ ( s i(h) * TjlXu 
for each time step i, but for the individual channels, the convo- 
lution leads to offsets of (s;(fjt) * Hjl)* from the global average 
when they have different trends which do not exactly cancel. For 
spectroscopically normalised data and sufficiently long time se- 
ries in which all drifts do statistically cancel, all three averaging 
methods should provide the same results. 
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Fig. 5. Average total power Allan variance spectra for the dif- 
ferent WBS subbands computed for the time series of data pre- 
sented in Fig. [T] 

For practical application, the method should be chosen 
which is most adequate for the need of astronomical observa- 
tions to control the drift error in measured data. Basically all 
spectroscopic observations are interested in the shape of a whole 
spectrum which is more than a bunch of independent channel 
data. Drift errors, showing up as irregular baseline distortions, 
can result in a clear degradation of the scientific value of the 
data even if the magnitude of the distortions does not exceed 
the radiometric noise in the data. To take the mutual relation of 
drift contributions across the spectrum into account we have to 
use the average of the baseline Allan variance or the Allan vari- 
ance relative to the grand average. Because the baseline Allan 
variance is not able to characterise total power drifts we propose 
to always use the "grand average" method. It combines the ad- 
vantage of the baseline Allan variance method reflecting the ob- 
server's view on spectroscopic data with the possibility of ana- 
lyzing the drift behaviour of an instrument including total-power 
variations. However, we want to stress again that the character- 
isation of the instrument by a single Allan variance spectrum is 
only justified if an inspection of a plot like Fig. [3] has revealed 
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Fig. 6. Radiometrically normalized channel-by-channel spectro- 
scopic drift Allan variance spectra, cr 2 h drift (L) = Bp\Lcr\(L)/2-l, 
for the average fluctuation bandwidth of Bpi = 2.1 MHz. The 
color bar gives the logarithm of this variance. White contours in- 
dicate parts of the spectrum where the measured variations drop 
below the average radiometric noise level, i.e. where the normal- 
ized spectra fall below zero. The data from Fig.Q]are used so that 
the figure can be compared to the Allan variance plot in Fig. [3] 



that no strong deviations of the drift behaviour across the spec- 
trometer occur. 

An intermediate level of analysis can be provided for array- 
spectrometers, like the HIFI-WBS, by characterising each spec- 
trometer subband individually (see Sect. 12.2b . Fig. [5] shows the 
resulting total-power Allan variance spectra for the HIFI labo- 
ratory measurement already used for demonstration in Fig. [3] 
The solid line represents the limit of pure radiometric noise. The 
trend of channels of higher number (frequency) having lower 
stability (Fig. [3) is clearly seen. For the full spectrometer we ob- 
tain a kind of intermediate behaviour. Comparing the plot with 
Fig. [4] shows that the total-power Allan variance values suffer 
from much stronger drift contributions than the spectroscopi- 
cally normalised values, with a noticeable drift already changed 
visible at very small lags. At all time lags below 100s, the spec- 
trum shows a typical slope of about -0.3. This is in agreement 
with stability measurements of the hi gh electron mob ility tran- 
sistors used in the receiver amplifiers (Whvborn, 2003), indicat- 
ing that the total-power stability of the overall system is mainly 
determined by their gain fluctuations. 



4. Interpretation of Allan variance spectra 

4. 7 . Comparison to radiometric noise 

The Allan variance always contains a combination of radio- 
metric and drift fluctuations. They can be separated based on 
their different spectral characteristics. Fluctuations with a f~ a 
power spectrum show up in the Allan variance as L a_1 spectra 
dSchieder & Krameil 120011) . The superposition of white radio- 
metric noise (a = 0) and a power law drift noise with an arbitrary 
spectral exponent a gives an Allan variance spectrum 

<ri{L) = + AL a - { . (14) 



Here, fipi is the fluctuation bandwidth per ba ckend channe l de- 
termined by the power spectrum of the noise (lKraui[T980l) and 
A characterises the amplitude of the instrumental drift. 

Subtracting the radiometric noise contribution, l/iB^L), 
from the Allan variance spectrum isolates the drift contribu- 
tions. Moreover, it is useful to normalise the drift contribution 
by the radiometric noise because all observations will aim for 
data where the error due to instrumental drifts is small compared 
to the radiometric error of the observation and the radiometric 
noise can be easily calculated. We obtain the normalised drift 
Allan variance as 

= d5) 

This describes the actual impact of the drift noise for an astro- 
nomical observation, as is demonstrated in Fig.|6]for the spectro- 
scopic channel-by-channel Allan variance of the data from Fig. 
Q] We find some regions where the drift contribution seems to be 
negative, indicated by the white contours. This is due to the fact 
that the fluctuation bandwidth is not completely constant across 
the spectrometer and when subtracting the radiometric noise for 
an average fluctuation bandwidth, we create slightly negative 
numbers for channels that have a fluctuation bandwidth that is 
eventually slightly larger than the average. The effect is always 
less than a few percent, so that we neglect it here. We recognise 
again the pattern of standing-wave like drift contributions, but 
the large scale gradient that was visible in the total-power Allan 
variance from Fig. [3] is absent. The drift noise is strongly vari- 
able across the spectrometer. At L — 300s it hardly exceeds the 
radiometric noise in the most stable regions while it exceeds it 
by a factor > 100 in the most unstable regions of the spectrum. 

We can use the knowledge of the shape of the radiometric 
noise contribution to derive the instrumental stability also from 
imperfect measurements not covering a continuous time series. 
If the spectrometer readout adds a significant dead time between 
individual integrations, Eq. ( fT4b does not hold any more because 
the radiometric noise is determined by the fraction of L used for 
the integration, L; nt = L-Ldead, while the drift is still determined 
by the total time lag between two measurements L. We can cor- 
rect for these dead times as long as the Allan variance at the first 
lag cr 2 A {Li,L mU \) is still purely radiometric or if we know the 
level of the radiometric noise from independent computations. If 
we scale the radiometric contribution by the factor L\ nl /L, we ob- 
tain again a self-consistent Allan variance spectrum, depending 
only on the filter size L: 

o\(L) = cr\(L, L int ) - cr\ (L, , L int ,i) X L dead;1 jL . (16) 

This corrected spectrum can be used in the same way as the spec- 
trum from perfect measurements to derive the Allan time. 

4.2. Definition of the stability time 

The Allan time is used to quantify the lag at which the Allan 
variance spectrums changes from being dominated by radiomet- 
ric noise to being dominated by the instrumental drift. The tra- 
ditional definition uses the minimum of the Allan variance spec- 
trum. At smaller lags the fluctuations are dominated by the ra- 
diometric noise that drops with the integration time given by the 
Allan filter size, at larger lags the drift terms dominate resulting 
in an increase of the fluctuations with filter size. This approach, 
however, is only applicable if the drift follows a usual spectral 
characteristics with an index a > 1 . Otherwise no minimum is 
formed. Figure [5] showed an example with an L~ 03 dependence 



8 



V. Ossenkopf: A unified Allan variance computation scheme 



of the Allan variance corresponding to a 1 /f 01 characteristics of 
the fluctuations and we have seen numerous other examples with 
a drift behaviour close to 1// noise leading to a very flat Allan 
variance spectrum. 

The use of the Allan minimum time t& thus has two disad- 
vantages: 

i) for drift noise shallower than 1// the Allan variance has no 
minimum although it is still a good measure for the stability of 
the system. 

ii) a small uncertainty in the spectral index of the drift function 
can lead to large shifts of the minimum making it very difficult 
to derive an accurate error estimate for the Allan minimum time 
from the statistical uncertainty of the Allan variance. 

Therefore, we propose another definition of the Allan time 
t' A based on the normalisation discussed above: t' A is the lag for 
which the drift contribution to the total uncertainty equals the ra- 



diometric contribution, i.e. C"a drift V 'A 



CO 



1 . This means that at t' A 



the total Allan variance amounts to twice the radiometric Allan 
variance. For a drift noise following a 1 // 2 spectral dependence, 
the new Allan time t' A agrees with the Allan minimum time t\. 

The new Allan time definition has two practical disadvan- 
tages compared to the Allan minimum time: 

i) It is easier to determine the minimum of the Allan variance by 
the naked eye than determining the point where it deviates by a 
factor 2 from the radiometric line. 

ii) Because most existing measurements characterise the instru- 
ment stability by the Allan minimum time, a comparison with 
their results requires an additional translation step. The relation 
between both Allan times can be computed from Eq. ( TBI ) as 

4 = (a-l) 1/ff ? A . (17) 

However, we can easily compute the uncertainty of the new 
Allan time t' A using the uncertainty of the Allan variance (Eq.|9j 
by 



K 1 SoIVa) 



(18) 



This error remains finite even in case of \/f noise whereas it 
diverges for the traditional Allan minimum time. 

4.3. Binning of spectra 

In astronomical data analysis it is common to use the average 
of several channels of a spectrometer to reduce the observational 
noise if the fixed resolution of the spectrometer is higher than the 
resolution needed to deduce physical parameters from the ob- 
served spectra. An example are observations of the [CII] line at 
1.9 THz with the HIFI-WBS in which the astronomer asks for a 
frequency resolution of about 1 km/s, corresponding to 6.3 MHz 
while the native spectrometer resolution is 1 . 1 MHz. It is a com- 
mon misconception to assume that the noise in the spectra will 
drop by a factor y/l/ll if the 1 1 channels are co-added that pro- 
vide the effective resolution of 6.3 MHz. 

For a correct treatment, the correlation between neighbour- 
ing channels has to be taken into account. The spectral corre- 
lation of the noise leads to a fluctuation bandwidth that dif- 
fers from the channel spacing. If the autocorrelation func- 
tion (ACF) of the spectrometer is known, the effective fluctu- 
ation bandwidth can be computed as a function of the binning 
width »bin, following the f ormalism provided in Appendix A of 
ISchieder & KramerlfeoOll) . 



#Fl(»bin) - «binAv c hannel X 



where Av c h an nei denotes the channel spacing and g m represent the 
values of the ACF at discrete channel shifts m. One can see that 
the native fluctuation bandwidth of the spectrometer («bin = 1) 
always exceeds the channel spacing by the symmetrically inte- 
grated autocorrelation function, for the HIFI WBS this is a factor 
of almost three. The ACF has typically only a few non-vanishing 
coefficients g m , so that for large values of «bin (large total bin- 
ning widths) Bpi approaches «bin A Vermel - Consequently, binning 
does not reduce the radiometric noise like VI /"bin relative to the 
noise at the native resolution, but in the limiting case of large bin 
widths the noise is still about a factor * V3 higher. 



Sub-band 1 
Sub-bond 2 
Sub-bond 3 
Sub-bond 4 
from ACF „ 
approximation _ 




[channels] 

Fig. 7. Spectroscopic Allan variance at L = 5 s for stability mea- 
surements of the HIFI WBS (V-polarisation) as a function of the 
channel binning width. The difference between the four WBS 
subbands is too small to be visible by eye. The dash-dotted line 
shows the theoretical curve co mputed from the measured auto- 
correlation function following ISchieder & Kramerl (|2001). The 
dashed line represents the simple approximation with an addi- 
tive constant. 



In Fig. Q we show this behaviour by computing the Allan 
variance for short lags in a stability measurement of the HIFI 
wide band spectrometer when applying a varying channel bin- 
ning to the data. The dash-dotted line represents the curve given 
by Eq. ( fT~9b using laboratory data for the ACF measured by trac- 
ing a tunable narrow line source. We find a good agreement be- 
tween the theoretical curve and the measured Allan variance data 
showing that we deal with pure radiometric noise at short lags, 
but a deviation by up to 10 % at «bin ~ 3 ... 7. The reason for this 
deviation is not clear. An imperfect line source used when mea- 
suring the ACF might lead to an overestimate of g m for higher 
m at cost of g\, resulting in this kind of deviation. Taking the 
typical error bars of the Allan variance (Sect. 13.21 ) and the natu- 
ral variation of the fluctuation bandwidth across a spectrometer 
(Sect. 14.11 ) into account, this small deviation can be completely 
neglected in the following. 

To quantitatively describe the observed behaviour of the fluc- 
tuation bandwidth it is possible to use an even simpler approx- 
imation consisting just of a linear dependence and an additive 
constant for the native fluctuation bandwidth: 



BFl(«bin) = Bh(1) + ("bin - 1)AV, 



channel • 



(20) 



i+2i^r 1 [i-»/(«Mn-i)]ft 



-(19) 



This is shown as the dashed line in Fig. [7] We find again a 
small deviation at intermediate bin sizes, but an overall reason- 
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able agreement, so that we can use this approximation for fast 
computations. 

With known fluctuation bandwidth for a particular chan- 
nel binning we can compute the corresponding Allan time by 
determining the ratio between drift noise and reduced radio- 
metric noise. It i s usually assumed dSchieder & Kramerl [2001 ; 
iKooi et all 120061) that the binning only reduces the radiometric 
noise while the instrumental drift itself is not affected. Resolving 
Eq. ( TBl i for t' A gives 



I 2 \ 1/a 
\ABmj 



(21) 



showing that the Allan time shifts to smaller lags when increas- 
ing the fluctuation bandwidth by 



4 ("bin) 



\BFl(»bin)/ ' 



(1) 



(22) 



This relation is identical to the corresponding relation fo r the 
traditional Allan minimum time (Schieder & Kra merl [20011) . 



oscillator, and IF amplifier chain (lower plot). We show the spec- 
troscopic Allan variance spectra for four different binnings and 
the native resolution. The data characterising the spectrometer 
alone perfectly follow the theoretical assumption of a constant 
drift contribution. Changing the binning width only changes the 
radiometric noise so that Eq. ( 122b applies. 

For the whole system, however, we find a significant change 
of the drift contribution with the binning width, indicating that 
the assumption of a constant drift term is in general not applica- 
ble. We notice two effects: 

i) the system is affected by some spectrally correlated fluctua- 
tions, like the unstable standing wave patterns discussed before, 
which are reduced by spectral binning. This leads to a reduction 
of the drift term and consequently to an increase of f^(«bin) rela- 
tive to the value predicted by Eq. d22l . 

ii) the overall system is always affected by some 1// noise. 
When steeper drift noise and the radiometric contribution are 
sufficiently reduced by binning, the 1 // noise starts to dominate 
the Allan variance. This reduces the Allan time relative to the 
value predicted by Eq. (l22l >. 
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Fig. 8. Spectroscopic Allan variance spectra characterising the 
stability of subband 2 of the HIFI wide band spectrometer using 
a stable noise source (upper plot) and using the whole system 
(HIFI band 3a, lower plot) for five different levels of channel 
binning. 

Figure [8] shows the impact of binning on the Allan variance 
spectra for data taken in a stability test of the spectrometer (up- 
per plot) and for a test of the full system including mixer, local 
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^A, e nd extrapolated 
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Fig. 9. Allan stability time t' A as a function of binning width for 
the stability measurements shown in the lower plot of Fig. [8] 
The red diamonds show the values measured from the individ- 
ual Allan variance spectra. The blue crosses and green triangles 
show the theoretically expected behaviour for constant drift con- 
tributions using t' A and a from the original (non-binned) data or 
from the data with the largest binning width. The best fit to the 
measured data gives t' A = 220 s and a — 1 .4. 



Altogether, this makes Eq. d22l) questionable. Analysing the 
system tests of the HIFI instrument in different configurations 
we noticed deviations in both directions, cases with strong shal- 
low noise, cases with narrow standing waves easily suppressed 
by binning, and cases with a complete cancellation, leading to an 
Allan time independent of the binning width. Finally we always 
performed the Allan variance analysis for a number of binning 
widths. The result for the HIFI band 3a measurements used in 
Fig.[8]is shown in Fig. [9] Together with the measured values of 
f^(«bin) we show the values that would be obtained from Eq. (1221 ) 
using the Allan time and spectral drift coefficient a measured 
for the first point (no binning) and the last point («bi n = 235) 
in the plot. Both extrapolations overestimate the Allan stability 
time at other binning widths. We can, however, obtain a fit to 
the data using Eq. d22"b by combining the information from all 
binning widths. This is shown as violet crosses which provide a 
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very good match to the measured values. By using two different 
values for the exponent a, one for the drift slope at a particu- 
lar binning width and one to characterise the change of t' A with 
the binning size, we can thus provide a full characterisation of 
the instrumental stability with an accuracy of typically some ten 
percent. 

5. Optimisation of the observations 

Schi eder & Kramerl d2001l) used the Allan-variance minimum to 
derive constraints for the optimum timing of astronomical obser- 
vations. They considered drift contributions with the two spec- 
tral indices a — 2, 3 bracketing the behaviour often observed 
in spectroscopic Allan variance measurements. In the analysis 
of numerous HIFI stability measurements, we noticed, however, 
that a major fraction of total-power Allan variance spectra and 
still a significant portion of spectroscopic Allan variance spec- 
tra is dominated by shallower noise spectra, often close to 1 // 
noise (see e.g. Fig. [5}. Thus we repeat their computation for the 
general case of arbitrary noise spectral indices, also applying the 
new Allan time definition discussed above. Corresponding equa- 
tions for the Allan minimum time were also derived by Schieder 
(priv. comm.). 

Many observing modes are symmetric in the sense that equal 
time intervals are spent on the astronomical source and on the 
reference. These are beam-switch observations, moving either 
the telescope or a fast chopping mirror between source and ref- 
erence, and frequency-switch observations. To compensate lin- 
ear drifts, the most appropriate observing scheme consists of 
reference-source-source-reference sequences, with an integra- 
tion time f s for each source phase, the same time f s in the ref- 
erence phases, and a dead time fa in between. 

By using the information about the instrumental drift ob- 
tained from the Allan variance spectrum, in particular the Allan 
time t' A and the spectral index of the drift a it is possible to 
compute the average drift error in each difference measurement 
S k - Rk, where S t is the integrated signal over the kth source 
phase and is the integrated signal during the kth reference 
phase. The total uncertainty of the astronomical measurement is 
then characterised by the variance 



(23) 



^L( f - f d) = (OS* - Rk - (S k - Rk) k ) 2 ) k ■ 

Fo llowing the formalism provided by Schi eder & Kramerl 
J2001 we can derive this variance normalised to the average 
signal level from Eq. ( [T4l 



^obs(^) 

(s) 2 



+A 



(24) 



(2? s + ? d r +1 - 2(t s + t d y +l + q +l - 2?f 1 

2(2 a - 2)tl 



The first term describes the radiometric noise which does not 
depend on the dead time. The second term is the drift noise. For 
fa — we return to the known relation ( TBI for the Allan vari- 
ance with no dead time between subsequent data dumps. Eq. (|25T > 
holds for all spectral indices a between and 3 except for a — 1 
where a logarithmic divergence occurs leading to a somewhat 
different functional description. 

Substituting A by t' A using Eq. (1211 1 and normalising all times 
relative to the Allan time gives 



<s> 2 



Bmt' A 



(25) 



(2x + d) a 



■ 2{x + d) a 



2x a 



2(2 a - 2)x 2 



with x = t s /f A and d = fa/t^. The use of the traditional Allan 
minimum time in this equation would add a factor 1 /{a - 1) to 
the drift term. For a — 2 and a = 3 one can t hen reproduce the 
results obtained by Schi eder & Kramerl (1200 ll) . 




Fig. 10. Total noise in beam-switch observations consisting of 
radiometric and drift contributions relative to the radiometric 
noise from an ideal instrument as a function of the relative chop 
phase length x. The different curves represent different relative 
dead time per cycle. A spectral index a = 0.7 is used for the drift 



The optimum observing mode is characterised by a mini- 
mum total noise, composed of radiometric and drift noise, ob- 
tained in a given observing time f tot . Summing up the t m /(2t s +fa) 
source-reference pairs fitting in the total observing time, we ob- 
tain the total noise of the observation as 



o- t 2 otO' d) 

( S y- 



4x + 2d 

fiFlftot 

/ 1 (2x + d)° 

x r 



2{x + d) a 



(26) 
■ 2x a+1 \ 



2(2 a - 2)x 2 



(see Eq. |7J. The behaviour of this total noise is shown in Fig. 
[TO] for a drift spectral index of 0.7 corresponding to the total- 
power measurements demonstrated in Sect. 14.11 We plot the 
standard deviation of the noise relative to the radiometric noise 
of an ideal instrument having no dead times, i.e. relative to 
0"ideai/(s) = 2/ V^Fiftot, as a function of the integration time 
per cycle relative to the Allan time t' A for different relative dead 
times. We find the same g eneral shape of the curve as shown by 
ISchieder & Kramerl d200lh for a drift spectral index of 2, with a 
high noise for short integration times due to the overhead from 
the dead time, an elevated noise for large integration times due 
to the instrumental drift and a minimum defining the optimum 
integration time. However, for the shallow drift index, the min- 
im a are much wider than the corresponding minima computed 
bv lSchieder & Kramerl d2001l) . 

We can use this plot to compute optimum cycle times from 
t' A in this case even if the Allan variance spectrum shows no 
minimum. We obtain the optimum integration time per cycle as 
a function of the instrumental dead time and the spectral index 
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Fig. 11. The optimum phase length as a function of the relative 
overhead from the dead time, d = t<i/f A , for different spectral 
indices a of the instrumental drift. 



of the drift contributions by 

■*opt = f A,Av root^(2jt + d) a+l (ax - d) + (x + d) a+1 d 

-2(x + d) a+l (2x + d)(ax + d)- d a+l (x + d) 
-x a+ 1 [a{2x + d)-d]- (2 a - 2)xd] (27) 



where root A {) denotes the solution of the expression with respect 
to x. 

Fig. QT| shows this optimum integration time providing the 
minimum total noise as a function of the dead time per cycle 
for a set of different spectral drift indices a. For spectral indices 
between 1 .5 and 3 the curves hardly depend on the exact value of 
a. When the dead time exceeds half the Allan time the optimum 
integration time saturates also at about half the Allan time. For 
shallow fluctuation spectra, however, the optimum integration 
time increases rapidly with the dead time so that it can easily 
exceed the Allan time for long dead times and spectral indices 
a < 1. 

This effect somewhat relaxes the constraints for planning ob- 
servations aimed at an accurate measurement of the continuum 
level. Although the total-power Allan time t' A is usually very 
short, the corresponding spectral index of the fluctuations it is of- 
ten very shallow, a » 1 , allowing cycle times which exceed the 
Allan time so that the frequency for switching between source 
and reference can be lower than the pure Allan time suggests. 

If the observations are set up with an optimum cycle length 
we can use Eq. (f27J to compare the expected drift noise from an 
observation with the radiometric noise. This ratio is essential for 
the observer because it characterises the amplitude of systematic 
baseline distortions due to instrumental fluctuations relative to 
the white noise in the spectra. It is a measure of the size of pos- 
sible baseline ripples which might be visible in the noise, and 
thus directly determine the quality of the observations. Figure[T2l 
shows the total noise relative to the radiometric contribution for 
the optimum cycle length, i.e. o" totopt /(i) x y/Bp\t tot /(4 + 2d/x). 
In case of shallow drift spectra we notice a major drift contribu- 
tion already for relatively small dead times whereas steep fluc- 
tuation spectra result in an almost linear growth of the drift con- 
tribution with dead time. However, as long as the dead time is 
smaller than about three Allan times, the total noise is increased 
by less than a factor 2, i.e. the drift contribution can still be hid- 
den in the radiometric noise of the baseline. 



Fig. 12. Total noise relative to the radiometric noise for the op- 
timum phase length as a function of the relative dead time per 
cycle, d = ta/t' A , for different spectral indices a of the instru- 
mental drift. 
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Fig. 13. Total noise RMS in a switched observation relative 
to the radiometric noise from an ideal instrument, <x tot 



opt 



y/Bpit tot /(2(s)), for the optimum phase length as a function of 
the relative dead time per cycle. 



Finally we can use Eq. (f27T > in astronomical time estimates, 
to provide the user with realistic numbers for the total data un- 
certainty obtainable in a given observing time. Figure [T3] shows 
the total noise relative to the radiometric noise from an ideal 
instrument, 2/ V^Fiftot, for the optimum cycle as a function of 
the spectral index of the instrumental drift and relative dead 
time. For dead times exceeding about half the Allan time the 
drift contribution has the smallest impact for very shallow noise 
spectra whereas steep spectra naturally create drift contributions 
that grow quickly in time. The figure gives a direct measure for 
the efficiency gain that can be obtained by constructing a faster 
chopper mechanism or a more rapidly moving telescope to min- 
imise the dead time relative to the Allan time. 

We can apply exactly the same approach to determine the 
timing in second order observing loops set up to correct residuals 
from the simple differencing measurements. A typical example 
is a dual beam-switch measurement where a chopping mirror 
switches quickly between source and reference, but where the 
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difference spectrum contains some standing wave residuals due 
to the different optical paths between the two mirror positions. 
In this situation, a second loop is used to periodically move the 
whole telescope so that the assignment of the two mirror posi- 
tions to source and reference is reversed. Adding the differences 
from the two telescope positions then removes the baseline resid- 
ual while maintaining the signal. To determine the period for the 
telescope motions, we have to consider the stability of the base- 
line ripple, i.e. the stability of the difference spectra. We call 
this second-order or differential stability, because first order in- 
stabilities will be removed already by the fast reference cycles. 
All computations used so far can be applied in the same way to 
determine the period of the second-order loop if the Allan vari- 
ance analysis is not applied to continuous measurements, but to 
differential measurements switching between source and refer- 
ence where the normalised difference spectrum is used for *,-(/■*). 
However, it is clear that the switching will introduce some dead 
times, so that the radiometric contribution has to be corrected 
following Eq. JTol l. In our HIFI tests, we found a very good sec- 
ond order stability for dual-beam switch measurements under 
most conditions, so that we could often only derive lower limits 
for the differential Allan time. The second-order stability is con- 
siderably worse for frequency-switch measurements following 
the same scheme. 

The formalism described above has been implemented in 
HSPOT, the Herschel observation planning tool, for the HIFI 
instrument guaranteeing an optimum setup of the observations 
and providing a realistic estimate for the quality of the data that 
can be obtained in a given observing time. We have to stress, 
however, that it is applicable in the same way for ground based- 
telescopes provided that stability measurements are performed 
for typical atmospheric conditions to obtain estimates for the 
Allan time and the drift exponent. 

6. Conclusions 

6.1. The optimum method 

We propose a new scheme for the computation of the Allan vari- 
ance of a time series of spectrometer data. It co mbines the ad- 
vantag es of the spectroscopic Allan variance by Schiede r"et al.l 
(1985) with th e advantages of the baseline Allan variance by 
Siebertz(1998) so that the same formalism can be used to anal- 
yse the stability of an instrument with respect to total-power fluc- 
tuations and with respect to spectroscopic fluctuations. 

We give two possible implementations for the algorithm to 
compute the Allan variance spectra which differ in the required 
computing power and the subjective "smoothness" of the re- 
sulting spectra although both are accurate within the achievable 
uncertainty of the total Allan variance analysis. Although it is 
usually required to characterise an instrument by a single stabil- 
ity number, we show that the use of an average is not always 
justified, but has to be checked in each case by visualising the 
channel-by channel Allan variance. For astronomical applica- 
tions we propose the "grand average" subtraction scheme pro- 
viding numbers most relevant for astronomical line observations. 

By introducing a new definition of the instrument stability 
time we can to characterise the instrument also in case of 1 // 
noise or shallower fluctuation spectra at the cost of not being di- 
rectly comparable to the traditional Allan minimum time. Using 
this stability time we compute the optimum observing strategy 
in symmetric differencing observations for arbitrary drift param- 
eters. If the appropriate loop timing is used, the total uncertainty 
of the measured spectra per given observing time will be min- 



imised. In case of moderate instrumental dead times relative to 
the Allan stability time it can guarantee that baseline ripples due 
to spectroscopic drifts remain hidden in the radiometric noise. If 
the instrument does not allow the use of the optimum chop cy- 
cle the drift noise can exceed the radiometric noise by orders of 
magnitude. The formalism presented here allows optimization 
of both total-power and spectroscopic observations, but the con- 
siderably lower total-power stability of any instrument demands 
separate setups for the two different scientific goals. 

6.2. Experience gained from testing HIFI 

The analysis of stability tests of the HIFI instrument showed that 
gain fluctuations represent the main cause of instrumental insta- 
bilities. We found that the temperature and mechanical stability 
is absolutely critical for a good performance. It turned out that 
changes in the pump level due to fluctuations in the LO power 
or standing waves in the optical path between mixer and LO 
are a major cause o f bad Allan stability times as predicted by 
ISiebertz et ail d2002l) . 

This results in first instance in total power instabilities. The 
total-power Allan times under good conditions can range from a 
few seconds up to about 20 s at 2 MHz fluctuation bandwidth. 
Due to slight impedance mismatches between mixer and ampli- 
fiers, any change of the pump level also creates a small change 
in the spectral response affecting the spectroscopic stability. The 
standing waves in the LO path also show a characteristic spectral 
instability imprint. Thus we obtain a reduced spectroscopic sta- 
bility as second-order byproduct of the gain fluctuations. Under 
good conditions we measured spectroscopic Allan times exceed- 
ing 100 s at 2 MHz fluctuation bandwidth. When removing first 
order drifts by difference measurements, the differential Allan 
variance of the resulting difference spectra measures higher- 
order instabilities. The available differential schemes result in 
spectroscopic Allan times of up to a few hundred seconds gov- 
erning the period of second-order observational loops. 

It turns out that spectroscopic binning removes part of the 
fluctuations seen in the Allan variance spectra, but it enhances 
the relative contribution of the underlying 1// noise always 
present in the gain fluctuations. Consequently, the impact of bin- 
ning on the Allan time cannot be predicted just from the mea- 
sured Allan variance spectrum at the native resolution of the 
instrument. It needs to be measured, but can be fitted by two 
independent parameters. 

The HIFI experience can be used in the same way for 
ground based telescope when the impact of the atmosphere is 
included in the Allan variance measurements, i.e. if the stability 
measurements are performed towards a celestial OFF position. 
Fluctuations of the atmospheric transmission will again affect 
mainly the total-power stability, but leave a characteristic spec- 
troscopic pattern in case of narrow absorption features in the 
observed spectral range. In case of a well-known shape of the 
transmission func tion, an appropriate atmospheric model (e.g. 
iPardo et all 120041) may be used to correct for this spectroscopic 
instability. 
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